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1. Introduction 



Topological field theory is a natural framework for "categorification", an informal 
procedure that turns integers into vector spaces (abelian groups), vector spaces into 
abelian or triangulated categories, operators into functors between these categories |1[]. 
The number becomes the dimension of the vector space, while the vector space becomes 
the Grothendieck group of the category (tensored with a field). This procedure can be 
illustrated by the following diagram ||: 



Categorification Categorification 

Number „ »- Vector Space „ " »- Category 

dimension Grothendieck Group \ -t • -t ) 

Recently, this idea led to a number of remarkable developments in various branches of 
mathematics, notably in low-dimensional topology, where many polynomial knot invariants 
were lifted to homological invariants. 

Although the list of homological knot invariants is constantly growing, most of the 
existing knot homologies fit into the "A-series" of homological knot invariants associated 
with the fundamental representation of sl(N) (or gl(N)). Each such theory is a doubly 
graded knot homology whose graded Euler characteristic with respect to one of the gradings 
gives the corresponding knot invariant, 

P(g) = X)(-l)VdimW i>i (1.2) 

i,3 

For example, the Jones polynmial can be obtained in this way as the graded Euler charac- 
teristic of the Khovanov homology |J. Similarly, the so-called knot Floer homology @,^| 
provides a categorification of the Alexander polynomial A(g). At first, these as well as 
other homological knot invariants listed in the table below appear to have very different 
character. Thus, as the name suggests, knot Floer homology is defined as a symplectic 
Floer homology of two Lagrangian submanifolds in a certain configuration space, while the 
other theories are defined combinatorially. In addition, the definition of the knot Floer 
homology admits a generalization to knots in arbitrary 3-manifolds, whereas at present 
the definition of the other knot homologies (with A > 0) is known only for knots in R 3 . 
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Knot Polynomial 


Categorification 




A(g) 


knot Floer homology HFK(K) 


u sl(l) n 


— 


Lee's deformed theory H'(K) 


sl(2) 


Jones 


Khovanov homology H Kh (K) 


sl(N) 


Pn{q) 


sl(N) homology HKR N (K) 



Table 1: A general picture of knot polynomials and knot homologies. 



The sl(N) knot homology 0,0,0 - whose Euler characteristic is the quantum sl(N) 
invariant Pn(q) - - has a physical interpretation as the space of BPS states, Heps, in 
string theory Q . In order to remind the physical setup of , let us recall that polynomial 
knot invariants, such as P/v(<?), can be related to open topological srting amplitudes ("open 
Gromov-Witten invariants") by first embedding Chern-Simons gauge theory in topological 
string theory 0, and then using the so-called large iV duality [p!Q| , pJ|Jl2]l , a close cousin 
of the celebrated AdS/CFT duality 0. Moreover, open topological string amplitudes 
and, hence, the corresponding knot invariants can be reformulated in terms of new integer 
invariants which capture the spectrum of BPS states in the string Hilbert space, TLbps- 
The BPS states in question are membranes ending on Lagrangian five-branes in M-theory 
on a non-compact Calabi-Yau space X = Opi (—1) ©Opi (—1). Specifically, the five-branes 
have world- volume R 2 ' 1 x Lk where Lk C X is a Lagrangian submanifold (which depends 
on knot K) and R 2 ' 1 C R 4 ' 1 . 



knot K 



Lagrangian 
submanifold 




Fig. 1: A membrane ending on a Lagrangian five-brane. 



2 



Surprisingly, the physical interpretation of the sl(N) knot homology naturally leads to 
a triply-graded (rather than doubly-graded) knot homology || (see also |b|,|15|). Indeed, 
the Hilbert space of BPS states, Hbps, is graded by three quantum numbers, which are 
easy to see in the physical setup described in the previous paragraph. The world-volume 
of the five-brane breaks the SO(4) = SU(2) x SU(2) rotation symmetry in five dimensions 
down to a subgroup U(1)l x U(1)r, where U(1)l (resp. U(1)r) is a rotation symmetry in 
the dimensions parallel (resp. transverse) to the five-brane. Therefore, BPS states in the 
effective M = 2 theory on the five-brane are labeled by three quantum numbers ji,, jr, and 
Q, where Q G H2CX, L>k) — 2 is the relative homology class represented by the membrane 
world-volume. In other words, apart from the ^-grading by the fermion number, the 
Hilbert space of BPS states TLbps is triply-graded. The properties of this triply-graded 
theory were studied in fRf; it turns out that this theory unifies all the doubly-graded 



knot homologies listed in Table 1, including the knot Floer homology. A mathematical 
definition of the triply-graded knot homology which appears to have many of the expected 
properties was constructed in [pTTfl - 

Apart from realization in (topological) string theory, the homological knot invariants 
are expected to have a physical realization also in topological gauge theory, roughly as 
polynomial knot invariants have a physical realization in three-dimensional gauge the- 
ory (namely, in the Chern- Simons theory |f[8| ) as well as in the topological string theory 
|9|, |T0| , |TT|| . Although these two realizations are not unrelated, different properties of knot 
polynomials are easier to see in one description or the other. For example, the dependence 
on the rank N is manifest in the string theory description, while the skein operations and 
transformations under surgeries are easier to see in the Chern-Simons gauge theory. 

Similarly, as we explained above, string theory realization is very useful for under- 
standing relation between knot homologies of different rank. On the other hand, the for- 
mal properties of knot homologies which are hard to see in string theory (which, however, 
would be very natural in topological field theory) have to do with the fact that, in most 
cases, knot homologies can be extended to a functor T from the category of 3-manifolds 
with links and cobordisms to the category of graded vector spaces and homomorphisms 

T{Y-K) = H Y ,K (1.3) 



!F(X;D) : TCy,K —>7~Ly';K' 
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(1.4) 



Moreover, on manifolds with corners, it is expected that T extends to a 2-functor from 
the 2-category of oriented and decorated 4-manifolds with corners to the 2-category of 



triangulated categories fll^ , poy21|| . In particular, it should associate: 

• a triangulated category .F(E) to a closed oriented 2-manifold E; 

• an exact functor F(Y) to a 3-dimensional oriented cobordism Y; 

• a natural transformation F(X) to a 4-dimensional oriented cobordism X. 

As we explain below, these are precisely the formal properties of a four-dimensional topo- 
logical field theory with boundaries and corners. Moreover, links and link cobordisms can 
be incorporated by introducing "surface operators" in the topological gauge theory. 

In section 2, we discuss the general aspects of topological gauge theories which admit 
surface operators. Of particular importance is the fact that every topological gauge theory 
which admits surface operators gives rise to an action of the braid group on D-branes. 
Then, in sections 3 and 4 we illustrate how these general structures are realized in simple 
examples of Af = 2 and Af = 4 twisted gauge theories. Specifically, in section 3 we 
study surface operators and the corresponding knot homologies in the Donaldson- Witten 
theory and in the Seiberg- Witten theory, both of which are obtained by twisting Af = 2 
supersymmetric gauge theory. In section 4, we explain that a particular twist of the Af = 4 
super- Yang-Mills theory — studied recently in connection with the geometric Langlands 
program [ 22], 23 1 - with a simple type of surface operators provides a physical framework 



for categorification of the G c Casson invariant. 



2. Gauge Theory and Categorification 

Let us start by describing the general properties of the topological quantum field 
theory (TQFT) with boundaries, corners, and surface operators. To a closed 4-manifold 
X, a four-dimensional TQFT associates a number, Z(X), the partition function of the 
topological theory on X. Similarly, to a closed 3-manifold Y, it associates a vector space, 
7Yy, the Hilbert space obtained by quantization of the theory on X = R x Y. Finally, to 
a closed surface E it associates a triangulated category, .F(E), which can be understood 
as the category of D-branes in the topological sigma-model obtained via the dimensional 
reduction of gauge theory on E. The objects of the category fF{Jf) describe BRST-invariant 
boundary conditions in the four-dimensional TQFT on 4-manifolds with corners (locally, 
such manifolds look like I = Rx R + x E). Summarizing, 
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gauge theory on X number Z(X) 

gauge theory onRx7 -w vector space TCy 
gauge theory on R 2 x E category .F(E) 

where we assume that X, Y, and E are closed. Depending on whether the topological 
reduction of the four-dimensional gauge theory on R 2 x E gives a topological A-model 
or B-model, the category .F(E) is either the derived Fukaya category^, Fuk(.M), or the 
derived category of coherent sheaves, D b (A4) := D b Coh(A4), 

topological A-model: .F(E) = Fuk(M) 
topological B-model: .F(E) = D b (M) 

where Ai is the moduli space of classical solutions in gauge theory on R 2 x E, invariant 
under translations along R 2 . Different topological gauge theories lead to different functors 
T . For example, in the context of Donaldson- Witten theory [p6| , Fukaya suggested [p7 



that the category associated to a closed surface E should be A^-category of Lagrangian 
submanifolds in the moduli space of flat G-connections on E. This is precisely what one 
finds from the topological reduction of the twisted Af = 2 gauge theory on R 2 x E, in 
agreement with the general principle discussed here. 

The Atiyah-Floer conjecture and its variants 

It is easy to see that T defined by the topological gauge theory has all the expected 
properties of a 2-functor. In particular, to a 3-manifold Y with boundary dY = E it 
associates a "D-brane", that is an object in the category .F(E). 

The interpretation of 3-manifolds with boundary as D-branes can be used to reproduce 
the Atiyah-Floer conjecture, which states [[29]: 

HF™\Y) £* HF* ymp (M; A, £ 2 ) (2.1) 

Here M. = -Mj Zat is the moduli space of flat connections on E, while C\ and £2 are 
Lagrangian submanifolds in A4 associated with the Heegard splitting of Y, 

Y = Y 1 U E Y 2 (2.2) 



1 Notice, according to the Homological Mirror Symmetry conjecture, this category is equivalent 
to the derived category of the mirror B-model p4| . In particular, the category Fuk(A / l), suitably 



defined, must be a triangulated category [25] . 
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a) 



b) 



Fig. 2: a) A 3-manifold Y can be obtained as a connected sum of 3-manifolds 
Y\ and Y2, joined along their common boundary S. b) In four-dimensional gauge 
theory, the space R x Y is obtained by gluing two 4-manifolds with corners. 

such that the points of C M. 1 i = 1, 2, correspond to flat connections on S which can 
be extended to Yi. 

Similarly, in the B-model, Y\ and Y<i define the corresponding B-branes, which are 
objects in the derived category of coherent sheaves on M.. In both cases, the vector space 
Tiy associated with the compact 3-manifold Y is the space of "1 — 2 strings" : 



In the Donaldson- Witten theory, this leads to the Atiyah-Floer conjecture ( |2.1| ). 

"Decategorification" 

The operation represented by the arrow going to the left in (|1.1| ) — "decategorifica- 
tion" — also has a natural interpretation in gauge theory. It corresponds to the dimensional 
reduction, or compactification on a circle. Indeed, the partition function in gauge theory 
on X = S 1 x Y is the trace (the index) over the Hilbert space Tiy- 



Similarly, the vector space associated with Y = S x E is the Grothendieck group of the 
category 



HF! ymp (M;£ 1 ,C2) A-model 
Ext* {JFy\ 5 ) B-model 



(2.3) 



(2.4) 




(2.5) 



(2.6) 
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2.1. Incorporating Surface Operators 



In a three-dimensional TQFT, knots and links can be incorporated by inrtoducing 
topological loop observables. The familiar example is the Wilson loop observable in Chern- 
Simons theory, 

W R (K) = Tr^Pexp jf^) (2.7) 

Recall, that canonical quantization of the Chern-Simons theory onSxR associates a vector 
space TLy, — the "physical Hilbert space" - - to a Riemann surface £ Pf . In presence 
of Wilson lines, quantization gives a Hilbert space Ti^-p^n^ canonically associated to a 
Riemann surface S together with marked points pi (points where Wilson lines meet E) 
decorated by representations E4. For example, to n marked points on the plane colored by 
the fundamental representation it associates V® n , where V is a iV-dimensional irreducible 
representation of the quantum group U q (sl(N)). 





a) 



b) 



Fig. 3: a) line operators in a three-dimensional TQFT onSxI and b) topological 
"surface operators" in four-dimensional gauge theory on E x / x R. 



We wish to lift this to a four-dimensional gauge theory by including the "time" direc- 
tion, so that the space-time becomes X = Y x R, where the knot K is represented by a 
topological defect (which was called a "surface operator" in [p3p localized on the surface 
D = K x R. In the Feynman path integral, a surface operator is defined by requiring 
the gauge field A (and perhaps other fields as well) to have a prescribed singularity. For 
example, the simplest type of singularity studied in |23[ creates a holonomy of the gauge 
field on a small loop around D, 

V = Hol(A) (2.8) 
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Quantization of the four-dimensional topological theory on a 4-manifold X = Y xTL with a 
surface operator on D = K xH gives rise to a functor that associates to this data (namely, 
a 3-manifold Y, a knot K, and parameters of the surface operator) a vector space, the 
space of quantum ground states, 

T{Y-K) =H Y ;K, parameters 

(2.9) 

Moreover, we will be interested in surface operators which preserve topological invariance 
for more general 4- manifolds X and embedded surfaces D C X. For example, if the four- 
dimensional topological gauge theory is obtained by a topological twist of a supersymmetric 
gauge theory, it is natural to consider a special class of surface operators which preserve 
supersymmetry, in particular, those supercharges which become BRST charges in the 
twisted theory. Such surface operators can be defined on a more general embedded surface 
D, which might be either closed or end on the boundary of X. An example of this situation 
is a four-dimensional TQFT with corners, shown on fig. 3, which arisies when we consider 
a lift of a 3-manifold with boundary E and line operators with end-points on E. 

To summarize, including topological surface operators in the four-dimensional gauge 
theory, we obtain a functor from the category of 3-manifolds with links and their cobor- 
disms to the category of graded vector spaces and homomorphisms: 

F(X;D) : H Y ;K^H Y >;K> (2.10) 

Here, the knot homology Hy;K is the space of quantum ground states in the four- 
dimensional gauge theory with surface operators and boundaries. Similarly, the functor 
T associates a number (the partition function) to a closed 4-manifold with embedded sur- 
faces, and a category jF(E;p^) to a surface E with marked points, pi, which correspond to 
the end-points of the topological surface operators. 

As in the theory without surface operators, the category .F(E;pj) is either the category 
of A-branes or the category of B-branes on Ai, depending on whether the topological 
reduction of the four-dimensional gauge theory is A-model or B-model. Here, Ai is the 
moduli space of R 2 -invariant solutions in gauge theory on X = R 2 x E with surface 
operators supported at R 2 x p^. 
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2.2. Braid Group Actions 

As we just explained, surface operators are the key ingredients for realizing knot 
homologies in four-dimensional gauge theory. Our next goal is to explain that every topo- 
logical gauge theory which admits surface operators is, in a sense, a factory that produces 
examples of braid group actions on branes, including some of the known examples as well 
as the new ones.@ 

In general, the mapping class group of the surface S acts on branes on M. In par- 
ticular, when E is a plane with n punctures, the moduli space M. is fibered over the 
configuration space Conf n ((D) of n unordered points on (D, 

M 

I (2-11) 
Conf n (C) 

and the braid group Br n = 7ri(Conf n ((D)) (= the mapping class group of the n-punctured 
disk) acts on the category .F(E). Recall, that the braid group on n strands, Br n , has n — 1 
generators, o~i, i = 1, . . . ,n — 1 which satisfy the following relations 

= CTi+lCjCTi+l 

(2-12) 

OiO-j = OjOi , \i - j\ > 1 

where o~i can be reprsented by a braid with only one crossing between the strands i and 
i + as shown on the figure below. 




Fig. 4: A braid on four strands. 



It is worth pointing out that, compared to P3[ , where the braid group action is associated 
with local singularities in the moduli space Ai, in the present context the origin of the braid group 
action is associated with global singularities. 
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In gauge theory, the action of the braid group on branes is induced by braiding of 
the surface operators. Namely, a braid, such as the one on fig. 4, corresponds to a non- 
contactible loop in the configuration space, Conf n ((D). As we go around the loop, the 
fibration ( |2.11| ) has a monodromy, which acts on the category of branes ^*(S) as an autoe- 
qui valence, 

Br n -> Auteq(J r (E)) 

(2.13) 

P ^ 0/3 

The simplest situation where one finds the action of the braid group Br n on A-branes (resp. 
B-branes) on M. is when Ai contans A n -i chain of Lagrangian spheres (resp. spherical 
objects). 

We remind that an A n _i chain of Lagrangian spheres is a collection of Lagrangian 
spheres C\, . . . , C n -i C M., such that 

#(£.n /y={i |;:jj=J (2.i4) 

These configurations occur when M. can be degenerated into a manifold with singularity 
of type A n -\. Indeed, to any Lagrangian sphere C C M., one can associate a symplectic 
automorphism of M., the so-called generalized Dehn twist Tc along £, which acts on 
H#(J\A) as the Picard-Lefschetz monodromy transformation 

= ( x -([£}■ x)[£] if dim(x) = dim(£) 
I x otherwise 

As shown in |3(|], Dehn twists Tc i along A n -i chains of Lagrangian spheres satisfy the 
braid relations ( |2.12| ), and this induces an action of the braid group with n strands on the 
category of A-branes, Fuk(A^). 

The mirror of this construction gives an example of the braid group action on B-branes 
|31}1 • In this case, the braid group is generated by the twist functors along spherical objects 



("spherical B-branes") which are mirror to the Lagrangian spheres. As the name suggests, 
an object £ G D b (M) is called <i-spherical if Ext*(£,£) is isomorphic to H*(S d ,<C) for 
some d > 0, 

Exf(£,£) = { C if ^ = ° OTrf (2.16) 
1 otherwise 

A spherical B-brane defines a twist functor Tg 6 Auteq(L> 6 (A^)) which, for any T G 
D b (A4), fits into exact triangle 

Hom*(£,.F)®£ — >T — >T £ (F) (2.17) 
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where the first map is evaluation. At the level of D-brane charges, the twist functor 
acts as, cf. ( ^.15| ), 

x i— > x + (v(£) ■ x) v(£) 

where v(£) = ch(£)^jTd(M.) G H*(A4) is the D-brane charge (the Mukai vector) of £. 

The mirror of an A n _i chain of Lagrangian spheres is an chain of spherical 

objects, that is a collection of spherical objects £±, . . . ,£ n -i which satisfy the condition 
analogous to ( |2.14p , 

£dimExt fc (^) = {j Jj:jj>! (2-18) 

With some minor technical assumptions , the corresponding twist functors Tg i generate 
an action of the braid group Br n on D b (A4). As we illustrate below, many examples 
of braid group actions on branes can be found by studying gauge theory with surface 
operators. 




Fig. 5: A particular brane B which corresponds to closing a braid on four strands. 

In A-model as well as in B-model, the braid group action on branes can be used to 
write a convenient expression for knot homology, TCk, of a knot K represented as a braid 
closure. Let K be a knot obtained by closing a braid f3 on both ends as shown on fig. 5. 
Then, the space of quantum ground states, TCk, in the four-dimensional gauge theory with 
a surface operator on D = R x K can be represented as the space of open string states 
between branes B and B' = (j)p(B). Here, B is the basic brane which corresponds to the 
configuration on fig. 5, while B' is the brane obtained from it by applying the functor (pp; 
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it corresponds to the braid f3 closed on one side. These are A-branes (resp. B-branes) in 
the case of A-model (resp. B-model), and the space open strings is, cf. (|2.3|) , 



Hk 



HF! ym v (M;B,(j)p(B)) A-model 
Ext* (B,(f)p(B)) B-model 



(2.19) 



In particular, when topological reduction of the gauge theory gives A-model, the branes B 
and B' are represented by Lagrangian submanifolds in M.. This leads to a construction of 



link homologies via symplectic geometry, as in [32,33,34]. 



3. Surface Operators and Knot Homologies in J\f = 2 Gauge Theory 

Now, let us illustrate the general structures discussed in the previous section in the 
context of M = 2 topological gauge theory in four dimensions. For simplicity, we consider 
examples of Af = 2 gauge theories with gauge groups G = SU (2) and G = U(l) known as 
the Donaldson- Witten theory and the Seiberg-Witten theory, respectively. In fact, these 



two theories are closely related [^5| — the former describes the low-energy physics of the 



latter — and below we shall use this fact to compare the corresponding knot homologies. 

3.1. Donaldson- Witten Theory and the Equivariant Knot Signature 

We start with pure M = 2 super- Yang-Mills theory with gauge group G which for 
simplicity we take to be SU(2). After the topological twist, the N = 2 gauge theory can 
be formulated on arbitrary 4- manifold X and localizes on the anti-self-dual ( "instanton" ) 
field configurations p6|j : 

F+ = (3.1) 

The space of quantum ground states on R x Y is the instanton Floer homology denned! 
by studying the dradient flow of the Chern-Simons functional, 

Uy = HFl nst (Y) (3.2) 



and the topological reduction []28| on R 2 x E leads to a topological A-model with the target 
space M. = -Mj Za4 , the moduli space of flat connections on E. As we already mentioned in 
the previous section these facts, together with the interpretation of boundaries as D-branes, 



3 As in the original Floer's definition, we mainly assume that Y is a homology sphere when we 
talk about HFl nst (Y) in order to avoid difficulties related to reducible connections. 
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naturally lead to the statement of the Atiyah-Floer conjecture (2J.). The Euler character- 
istic of Tiy is the Casson invariant, Xq(Y), which computes the Euler characteristic of the 
moduli space of flat G-connections on Y, 

X {n Y )=A\ G {Y) (3.3) 

In the special case of G = 577(2) that we are mainly considering here, it is the standard 
Casson- Walker-Lescop invariant Xcwl^X) which sometimes we write simply as X(Y). 

We note that, while the homo logical invariant Tiy is difficult to study on 3- manifolds 
with bi > 1, its Euler characteristic - - which is, at least formally, computed by the 
partition function of the four-dimensional gauge theory on I = S 1 x F — is still given by 



the Casson invariant [36 



Z DW (S 1 xY)=4\ (3.4) 

Since b^{X) = b\(Y) for X = S 1 x Y 1 computing ( |3.4j ) is much easier in the case b\(Y) > 1. 
Indeed, in general the Donaldson- Witten partition function Zdw(X) can be written as a 
sum of the contribution of the Coulomb branch (the it-plane integral) and two contribu- 
tions, Zm and Zo, both of which are described by the Seiberg- Witten theory (that we 
consider in more detail below): 



'DW 



Z u + Z M + Z D (3.5) 



For manifolds X = S 1 xY with b\{Y) > 1 the it-plane integral vanishes and we have Zm = 
Zd = 2A(y), which then add up to ( |3.3| ). If bi(Y) = 1, the Donaldson- Witten partition 
function Zjy\y(S 1 x Y) depends on the metric. In particular, it should be compared with 
the Euler characteristic of Tiy i n the chamber R — ► oo, where R is the radius of S 1 . In this 
case, the w-plane integral is non-zero, and instead of ( |3.4j ) one finds a similar expression 
with the "correction" — ||Tori7i(Y, Z)|, see [|36| for more details. 



Surface Operators 

Now let us consider surface operators in the Donaldson- Witten theory which corre- 
spond to the singularity of the gauge field of the form 

A = ad6 + . . . (3.6) 

Here, (r, 9) are radial coordinates in the normal plane, a is the parameter which labels 
surface operators and takes values in t = Lie(T), the Lie algebra of the maximal torus 
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T C G, and the dots in (|3.6|) stand for less singular terms. More precisely, inequivalent 
choices of a are labeled by elements in T = t/A coc h ar since gauge transformations shift a 
by vectors in the cocharacter lattice A coc har of G. For example, for G = SU (2) we have 
T = U{1). 

In the presence of a surface operator on D C X , supersymmetric field configurations 
in this theory are described by the instanton equations (|3.1[) : 



F+ = 27ra(S D ) + (3.7) 

perturbed by the term 27tq;(5d) + , where (Sd)+ denotes the self-dual part of the cohomology 
class that is Poincare dual to the surface D. In the context of 577(2) gauge theory, such 
surface operators were extensively used in the work of Kronheimer and Mrowka on minimal 



genus problems of embedded surfaces in 4-manifolds [j37| , |38| . 

According to the general rules outlined in the previous section, to a 4-manifold X = 
R x Y and a surface operator on D = R x K labeled by e 27Tlct £ T the Donaldson- Witten 
theory associates a vector space, the space of quantum ground states, 

H Y ,K, ce = HFr t (Y;K,a) (3.8) 

Just like the ordinary instanton Floer homology ( |3.3j ), it categorifies a Casson-like invariant, 

x(H Y .,K, a )=\ a (Y;K) (3.9) 

which counts flat SU(2) connections on a homology sphere Y with the prescribed singu- 
larity fl3.6|) along K. 

In order to describe X a (Y;K) more explicitly, it is convenient to decompose Y as 
in ( |2.2| ) into a tubular neighborhood of the knot K, Y\ = N(K), and its complement, 
Y<i = Y \ N(K), glued along the common boundary E = T 2 . As we already mentioned 
earlier, topological reduction of the Donaldson- Witten theory on E yields a topological 
A-model with the target space Ai = M.^ lat , the moduli space of flat connections on E: 

M% at = {p: 7ri(£)->G}/conj. (3.10) 

For E = T 2 this moduli space is the quotient, M.fi at = (T x T)/W, of two copies of the 
maximal torus by the Weyl group of G. In particular, for G = SU(2) the corresponding 
moduli space A^^ Zat = T 2 /2 2 is often called the "pillowcase" . Similarly, each component in 
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the decomposition Y = YiUsY^ defines an A-brane supported on a Lagrangian submanifold 
in JAf lat . If we denote Lagrangian sub manifolds associated to Y\ and Y 2l respectively, by 
C a and Cy\Ki then the invariant Q3.9|) is given by their intersection number (in the smooth 
part of M% t ): 

\ a (Y;K) = #(£ a n£ Y \ K ) (3.11) 

Note, the Lagrangian brane supported on C a does not depend on K or Y, while the 
Lagrangian brane supported on Cy\K does not depend on a. Indeed, C a is simply the 
set of representations p E Ai9 lat taking the meridian of the knot K to a matrix of trace 
tr(p M ) = 2 cos Tree. Similarly, the Lagrangian brane supported on Cy\K corresponds to flat 
connections on £ = T 2 which can be extended to flat connections on Y \ K. In other 
words, Cy\K is the image of M.^ lat (Y \ K) under the restriction map 

r:M% at (Y\K)^M% at (T 2 ) 

induced by the inclusion of the torus boundary of the knot complement, T 2 <— > Y \ K. 

To summarize, surface operators in the Donaldson- Witten theory lead to a variant 
of the instanton Floer homology, Ti.Y K.ai whose Euler characteristic is a Casson-like in- 



variant (3.11). This is precisely the definition of the knot invariant which was introduced 



and studied in [p9| , ^0|j4l]1 (see also p2| , |43]1 ). This invariant, sometimes called Casson-Lin 



invariant, is well-defined away from the roots of the Alexander polynomial of K and turns 
out to be equal to the linear combination of more familiar invariants, a G [0, 1], 

K{Y-K)=A\{Y) + \a a (K) (3.12) 

where X(Y) is the Casson invariant of Y and a a {K) : £7(1) — > 2 is the equivariant signature 
function ( a.k.a. Levine- Tristram signature) of the knot K. Homology theory categorifying 
X a (Y;K) was constructed in [|4| (see also [f!5| , [46|| ) and, therefore, is expected to be the 
same as (|3.8| ). 

We remind that, for a knot K in a homology sphere Y, the normalized Alexander 
polynomial is defined as 

A(K; q) = det (V /2 V - g -1 / 2 V T j (3.13) 

where V is the Seifert matrix of K and q = e 27Tlct . Note, that A(K; q) = A(K; q -1 ). The 
equivariant signature a a (K) is defined as the signature of the Hermitian matrix 

B K (q) = (1 - q)V + (1 - q)V T (3.14) 
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The equivariant signature function changes its value only if q = e 2 ' Kia is a root of the 
Alexander polynomial. It vanishes for a near or 1, 

lim a a (K) = (3.15) 

a— >0,1 

and equals the standard knot signature, cr(K), for a = \. In particular, for Y = S 3 and 
a = \ we get the original Lin's invariant [^9| and the corresponding homology theory 
categorifying Xi(Y;K) was constructed — as symplectic Floer homology ( |2.19| ) of the 



braid representative of K — in [H7I . 



3.2. Seiberg-Witten Theory 

Now let us consider Af = 2 twisted gauge theory with abelian gauge group G = U(l) 
coupled to a single monopole field M. This theory localizes on the solutions to the Seiberg- 
Witten equations for abelian monopoles | i8fl : 



F+ + t(MM) + = 

(3.16) 

P A M = 



which follow from the Af = 2 topological gauge theory-! The partition function of this 
theory on a 4-manifold X with 2-observables included is a generating function of the 



4 Up to the finite group -ff 1 (X, ^2), the set of Spin c structures on a 4-manifold X is parame- 
terized by integral cohomology classes which reduce to W2(X) mod 2, 

Spin c (X) = {x G H 2 (X, Z) | x = w 2 (X) mod 2} 

Given a Spin c structure x E Spin c (X), let L be the corresponding Hermitian line bundle, and 
the corresponding spinor bundles. Then, the Seiberg-Witten monopole equations ( |3 .16 ) are 



equations for a pair (A, M), where A is a unitary connection on L and M is a smooth section of 
■ In writing the equations ( 3.16| ) we used the Dirac operator, p A : — »■ S^, and a map 



Q°(S+) ^fi°(ad 5+) 
M ^ i(MM)+ 

I 0( S+ = is the subbundle of the adjoint bundle of consisting of the traceless 
skew-Hermitian endomorphisms, which can be identification with the space of self-dual 2-forms. 
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Seiberg-Witten invariants, SWx(x), which "count" solutions to ( j3.16|) and can be viewed 
as a function of x G Spin c (X), 

SW X : Spin c (X) -> Z 

To be more precise, the Seiberg-Witten invariants are defined as integrals over Ai x , the 
moduli space of solutions to the Seiberg-Witten equations ( |3.16| ), 

SW x (x) = [ a d £ /2 
Jm x 

where d x = \{x 2 — 2%(X) — 3a(X)) is the virtual dimension of M. x , and ao is a 2-form 
which represents the first Chern class of the universal line bundle on the moduli space M. x . 

The space of quantum ground states in this theory is the Seiberg-Witten monopole 
homology, 

H Y = HM*(Y) (3.17) 



which is conjectured to be isomorphic to the Heegard Floer homology, see e.g. |49 



HM*(Y) = HF*(Y) (3.18) 

In turn, the Heegard Floer homology HF*(Y) — as well as its analog for knots, the knot 
Floer homology HFK*(K), that is closer to our interest — is defined as the symplectic 
Floer homology of certain Lagrangian submanifolds in the symmetric product space of the 
form 

M = Sym fc (E) (3.19) 

The symmetric product space and Lagrangian submanifolds in it naturally appear in the 
topological reduction of the Seiberg-Witten theory. Indeed, on X = R 2 x E the equa- 
tions ( |3.16| ) reduce to the vortex equations in the abelian Higgs model, and the moduli 
space of solutions to these equations, namely the moduli space of charge k vortices, is the 
symmetric product space ( |3.19| ), see As in the case of the Donaldson- Witten theory, 
the topological reduction of the Seiberg-Witten theory leads to the topological A-modeli 
with M. as the target space, and the corresponding category of branes in this case is the 
category of A-branes, 

= Fuk(M) (3.20) 



5 In fact, this is true for any four-dimensional J\f = 2 gauge theory with the same type of 
topological twist p8| . 
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According to the general rules explained in the previous section, the Euler charac- 
teristic of the homology theory (|3.17| ) - ( |3.18[ ) is given by the partition function of the 
Seiberg-Witten theory on X = S 1 x Y (in the chamber R — > oo): 



Z SW (Y)= SW Y (x) (3.21) 

x6Spin c (y) 

If bi(Y) > 1, then there are no wall-crossing phenomena and Zsw(Y) can be equivalently 
viewed as the partition function of the three-dimensional gauge theory on Y obtained 
by the dimensional reduction of the Seiberg-Witten theory. For a fairly general class of 
3-manifolds Y, the partition function ( |3.21| ) is equal to the Casson invariant of Y, c.f. 

ZswiX) = X(Y) (3.22) 

For instance, for 3-manifolds with bi(Y) > 1 it follows e.g. from the general result of 
Meng and Taubes [5^] that will be discussed in more detail below. On the other hand, 



for homology spheres the definition of the Seiberg-Witten invariants requires extra care. 
However, once this is done, one can show that ( |3.22| ) still holds for suitably defined ZswiX)\ 
see ]5^,[|5],|55| for a mathematical proof and [^6| for a physical argument based on the duality 
with Rozansky-Witten theory |)7| . 

Surface Operators 

As in the Donaldson- Witten theory, we can introduce surface operators by requiring 
the gauge field to have the singularity of the form (|3.6| ). In the Seiberg-Witten theory, 
such surface operators are labeled by e 2? " a G U(l). In the presence of a surface operator 
on D C X , supersymmetric field configurations are described by the perturbed Seiberg- 
Witten monopole equations, cf. |48|,|58|: 



F+ + i(MM)+ = 2na{5 D ) + 

(3.23) 

P A M = 

As usual, in order to obtain a homological invariant of a knot K in a 3-manifold Yq one 
should consider the Hilbert space of the gauge theory on X = R x Y with a surface 
operator on D = R x K. In the context of Seiberg-Witten theory, this gives a vector space 
Ti.Y -K;x,a- More generally, given a link L with I components one can introduce t surface 
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operators, each with its own parameter a^, * = !,...,£ The corresponding Hilbert space 



is 



%;L;x„ ai = HM,{Y- x u on) (3.24) 

where V = Yo \ is the link complement, and parameters a.i determine the boundary 
conditions on Y. Namely, the holonomy of the U(l) gauge connection A along the meridian 
of the i-th link component should be equal to e 27FlQ?i . We will be mainly interested in the 
case where Yq = S 3 and Y = S 3 \ L is the link complement. In this case, ( |3.24j ) gives 
(£ + l)-graded link homology. 

We introduce the graded Euler characteristic of the homological invariant ( |3.24j ), 

r ai (Y ]qi ):= ]T x (HM*(Y; x u a,)) ■ q x (3.25) 

xeH(Y) 

which is a formal power series in g 4 1 , where qi = e hi and hi are the generators of a free 
abelian group, 

H(Y) := H X {Y, 2) /torsion = Z bl(y) 

In particular, when Y is a link complement, the group H(Y) = Hi(Y, 2) = 11} is generated 
by the meridians of the link components. 

In general, r ai (Y; qj) is a non-trivial function of qi and aj. It is equal to the partition 
function of the Seiberg-Witten theory on X = S 1 x Y (in the chamber R — ► oo): 

r ai (Y; gi )= SW Y (x,a l )-q x (3.26) 

xeH(Y) 

This function is an interesting generalization of the Reidemeister-Milnor torsion, on the 
one hand, and the equivariant knot signature, on the other. Indeed, since the Seiberg- 
Witten theory is the low-energy description of the Donaldson- Witten theory, we expect 
the relation to the equivariant knot signature. On the other hand, if is near or 1 



for allz = 1, ...,£, as in (|3.15|) , then the partition function Zsw(X\ x ii a i) = T on(y ''■> Qi) 
becomes the ordinary partition function of the link complement Y studied by Meng and 
Taubes [^2| who showed that it is equal to the Reidemeister-Milnor torsion. Hence, 

Urn T ai (Y; qi )=T(Y; qi ) (3.27) 

on— >0,1 
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where r(Y;qi) is the ordinary Reidemeister-Milnor torsion of Y. In particular, for 
bi(Y) > 1 we have t(Y\ q^) = A(L;qi), so that in this limit the homological invariant 
( |3.24| ) categorifies the multi- variable Alexander polynomial A(L; qi) of the link L, 

x(H L ., x )-q x =A(L;q) (3.28) 

xeH(Y) 



This suggests to identify the (£ + 1) -graded homology theory ( |3.24| ) with the link Floer 
homology 

H L ; X = HFL*(L;x) (3.29) 

In the case of knots, the relation to the Alexander polynomial A(K; q) is slightly more 
delicate, in part due to metric dependence and wall crossing. It turns out, however, that 
even though individual Seiberg-Witten invariants are different in the positive and negative 
chamber, the corresponding generating functions are both equal to the Milnor torsion ||52[| , 
so that (|3.27|) still holds. Note, that specializing ( |3.27| ) further to qi = 1, we recover ( |3.22|) . 
It would be interesting to study the invariant T a (Y;q) further, in particular, its relation 
to the equivariant knot signature a a (K). 



4. Surface Operators and Knot Homologies in J\f = 4 Gauge Theory 

Now, let us consider surface operators and knot homologies in the context of M = 4 
topological super- Yang-Mills theory in four dimensions. Specifically, we shall consider the 
GL twist of the theory [p2~j , with surface operators labeled by regular semi-simple conjugacy 



classes [ 53[ . As we shall explain below, this theory provides a natural framework for cate- 
gorification of the G c Casson invariant, which counts flat connections of the complexified 
gauge group G c . 



The topological reduction of this theory leads to a Af = 4 sigma-model pBLIBIirZ? 



whose target space is a hyper-Kahler manifold A4h(^, G), the moduli space of solutions 
to the Hitchin equations on E |H] : 



F-(f)A(j) = 

(4.1) 

aA(p = 5 dA * <P = 

This twist of the M = 4 super- Yang-Mills theory has a rich spectrum of supersym- 
metric surface operators. In particular, here we will be interested in the most basic type 
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of surface operators, which correspond to the singular behavior of the gauge field A and 
the Higgs field of the form f23[| : 



A = ad6 + . . . , 

dr ( 4 - 2 ) 
<f> = /3 7<Z0 + . . . 



r 



where a, /3, 7 G t, and the dots stand for the terms less singular at r = 0. For generic 
values of the parameters a, /3, 7, eq. ( |4.2| ) defines a surface operator associated with the 
regular semi- simple conjugacy class (£ G G c . 

According to the general rules explained in section 2, this topological field theory 
associates a homological invariant Tiy to a closed 3-manifold Y and, more generally, a 
knot homology TCy,K to a 3-manifold with a knot (link) K. These homologies can be 
computed as in ( |2.3| ) and ( |2.19|) using the Heegard decomposition of Y as well as the braid 
group action on branes. The branes in questionsi are branes of type (A, 5, A) with respect 
to the three complex structures (I, J, K) of the hyper-Kahler space G). We can use 

this fact and analyze the branes in different complex structures in order to gain a better 
understanding of the homological invariant H.y,k as well as the G c Casson invariant itself. 
For example, in complex structure I it corresponds to counting parabolic Higgs bundles, 
a fact that has already been used e.g. in |52| for studying the SL(2, C) Casson invariant 



for Seifert fibered homology spheres. 

Complex Structure J: Counting Flat Connections 

The B-model in complex structure J is obtained, e.g. by setting the theta angle to 
zero, Re(r) = 0, and choosing t = i (where t is a complex parameter that labels a family of 
GL twists of the Af = 4 super- Yang-Mills lf22~| ). In complex structure J, the moduli space 
A4h(^,G) = M. j^ t (E) is the space of complexified flat connections A = A + i(f>, and the 
surface operator (\1.2\) creates a holonomy, 



V = Hol(^), 

which is conjugate to exp(— 2ir(a — 27)). Furthermore, at t = i the supersymmetry 
equations of the four-dimensional gauge theory are equivalent to the flatness equations, 
dA + A A A = 0, which explains why (from the viewpoint of complex structure J) the 



e.g. branes £>i and B2 associated with the Heegard decomposition Y = Yi Ue Y2 



21 



partition function of this theory on X = S 1 x Y with a surface operator on D = S 1 x K 
computes the G c Casson invariant, 



Z = X Gc (Y;K) 

The space of ground states, TCy,K, is a categorification of \q c (Y; K). In general, both 
Xq c (Y) K) and Hy,k depend on the holonomy V, which characterizes surface operators. 
However, if V is regular semi-simple, as we consider here, then \q c (Y; K) and TCy,K do 
not depend on a particular choice of V. 

Complex Structure K 

Since the four-dimensional topological gauge theory (even with surface operators) does 
not depend on the parameter t that labels different twists, we can take t = 1, which leads 
to the A-model on M. H {Yi,G) with symplectic structure uk- This theory computes the 
same G c Casson invariant and its categorification, Hy k, but via counting solutions to 



the following equations on Y [22 



F - <f> A = *( J D0 O - [A , 0]) 

*D<j) = [0 O ,0]+ DA (4.3) 
* D*<fi + [A Q , o ] = 

rather than flat G c connections. In particular, given a Heegard decomposition Y = Y\ 
Y 2 , the space of solutions to the equations ( fO| ) on Y"i (resp. Y 2 ) defines a Lagrangian 
A-brane in M. H (Yi,G) with respect to ujk- This allows to express Hy-k as the space of 
open string states between the corresponding A-branes £>i and £>2, c/. (|2.3j), 



Hy-k = HF^(M h ;B u B 2 ) 

This alternative definition of the G c Casson invariant and its categorification that follows 
from the twisted N = 4 gauge theory can be useful, for instance, for understanding sit- 
uations when the (A,B,A) branes B\ and B 2 intersect at singular points in M.h o r over 
higher-dimensional subvarieties. 

Categorification of the 5'L(2,C) Casson Invariant 

Now, let us return to the complex structure J and, for simplicity, take the gauge group 
to be G = SU(2). Furthermore, we shall consider an important example of the sphere with 
four punctures: 

E = CP 1 \ {pi,P2,P3,M 
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which in gauge theory corresponds to inserting four surface operators. In complex structure 
J, .Mh(£, G) is the moduli space of flat G c = SX(2,(D) connections with fixed conjugacy 
class of the monodromy around each puncture. It can be identified with the space of 
conjugacy classes of monodromy representations 

M H (X, G) = {p: tti(E) - G c | p( 7l ) G ~ 

where the representations are restricted to take the simple loop 7$ around the i-th puncture 
into the conjugacy class Ci C G c . 




Fig. 6: Sphere with four punctures. 



Using the fact that 7Ti(£) is free on three generators, we can explicitly describe the 
moduli space M.h(E, G) by introducing holonomies of the flat SL(2,G) connection around 
each puncture, 

Vi=Rol Pi (A) , i = l,..., 4 (4.4) 



where V1V2V3V4 = 1 and each V% is in a fixed conjugacy class. Following P^ , p4] . p5|j6q , p7 
we introduce the local monodromy data 



and 



/ trVJ 

\tr{VzV 2 V x 



9i = ai<l4 + CL2(l3 

#2 = a 2 a 4 + aia 3 
83 = asa^ + a^a\ 



1,2,3 



(4.5) 



(4.6) 



84 = 0,10,20.30,^ + of — 4 
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which determines the conjugacy classes of V^. We also introduce the variables 

Xl = tr{V 3 V 2 ) 

x 2 =tr(V 1 V 3 ) (4.7) 
x 3 = tr(V 2 V 1 ) 

which will be the coordinates on the moduli space A4h(^, G). Namely, the moduli space 
we are interested in is 

M H (E,G) = {(V 1 ,...,V A ) [Vied, V l V 2 V 3 V 4 = l}/G c 

In terms of the variables Q4.71) , it can be explicitly described as the affine cubic 

M H (Z, G) = {On, x 2 , x 3 ) G <D 3 I f( Xi , 9 m ) = 0} (4.8) 

where 

3 

f(Xi, 6 m ) = X X X 2 X 3 + ^(x? - OiXi) + 9 4 (4.9) 



i=l 



Singularities in M.h 

For certain values of the monodromy data, the moduli space M.h becomes singular. 
It is important to understand the nature of the singularities and when they develop. In 
fact, as we shall see below, inetersting examples of branes pass through such singularities. 

The descriminant A(/) of the cubic ( |4.9| ) is a polynomial in 04 of total degree 16 [ 55 ]: 

A(a) = ( n (° 4 + yi e * a - n>* G4 - a ^ afc ) ) - ^ ( 4 - iq ) 



where = ±1. A special subfamily of cubics (|4.9|) , which will play an important role in ap- 
plications to knot invariants discussed below, corresponds to the case where all monodromy 
parameters a« are equal, a« = a, i = 1, 2, 3, 4. In this case, 

9 l =2a 2 , i = l,2,3 

(4.11) 

9 4 = a 4 + 4a 2 - 4 

and it is easy to verify that A(a) = 0. Specifically, for generic values of the parameter a, 
the moduli space M.u has three simple singularities of type A\ (double points) at 

{xi, Xj ,x k ) = (a 2 -2,2,2) (4.12) 
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These singularities correspond to reducible flat connections. For special values of a, the 
singularities can become worse and/or additional singularities can appear. For example, 
for a 2 = a new singularity of type A\ develops at the point {x\, X2, £3) = (—2, —2, —2). 
On the other hand, for a 2 = 4 the moduli space has a simple singularity of type D4 at 
(x 1 ,x 2 ,x 3 ) = (2,2,2). 

Braid Group Action 

The mapping class group of E, which in the present case is the braid group Br 3, acts 
on the family of cubic surfaces (|4.fcj| ) by polynomial automorphisms. In particular, one can 
verify that the generators Oi, i = 1,2, 3, represented as j63[: 



9j, Qi, 9k, #4) 



(4.13) 



satisfy the relations OiOjOi = OjOiOj and = OiOjO i 1 . Here and below we denote by 
(i, j, k) any cyclic permutation of (1, 2, 3). 

Examples 

Let us consider examples of (A, B : A) branes that arise from knotted surface operators 
in R x B 3 , where B 3 denotes a 3-dimensional ball. We consider surface operators which 
are extended along the R direction and which meet the boundary S 2 = <9B 3 at four points. 
The simplest example of such brane is 



brane B 




(4.14) 



We shall denote this brane B (or #(14) (23) if we wish to specify which pairs of points on S 2 
it connects). Since the brane ( |4.14j ) identifies the monodromies around the points 1 and 4 
(resp. 2 and 3), 



v 2 



V3- 1 



(4.15) 



it can be explicitly described as a subvariety of M.h defined by 



x x = tr(l/ 3 ^2) = 2 
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(4.16) 



Of course, we also need to set a± = and a 2 = «3, so that 

6>i = a\ + a\ 
#2 = O3 = 2aia 2 
6> 4 = a\a\ + 2a\ + 2af - 4 



Substituting (|4.16|) and (|4.17|) into the cubic equation f(xi, 9 r 
Q1.14|) can be described as a degenerate quadric, 

(x 2 + x 3 - aia 2 ) 2 = 



(4.17) 



0, we find that the brane 



(4.18) 



One can also think of it as a set of two coincident branes on x 2 + X3 = aia 2 - By acting on 



this brane with the elements of the braid group ( |4.13| ), we can construct other examples 
of (A, B, A) branes in M.h- Furthermore, by closing the braid one can obtain homological 
invariants of knots (links) in S 3 as spaces of open strings between two such branes. In the 
rest of this section, we consider a few explicit examples. 

Unknot : One way to construct the unknot is to take surface operators which correspond 



to two branes of type ( |4.14| ), as shown on the figure below: 




Fig. 7: Unknot in S 3 can be represented as a union of two branes £>. 



The two branes on this figure are branes B(i4)( 2 3) and £>(i2)(34)- We already discussed the 
first brane: it is described by the conditions ( |4.16| ) - ( ^.18|) . Similarly, the brane #(12) (34) 
is given by V\ = V 2 which implies V3 = U 4 _1 , 

x 3 =ti(V 2 V 1 ) = 2 (4.19) 

and the corresponding conditions for 6>j, cf. ( fll7| ). Altogether, the conditions describing 
these two branes imply that the local monodromy data should be identified, 

cii = a 2 = CL3 = CI4 = a (4.20) 
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This condition is very natural, of course, and will be relevant in all the examples where 
the resulting link has only one connected component, i.e. is actually a knot. Furthermore, 
for the unknot in fig. 7 we have: 



Vi = V 2 ~ l = V 3 = Kf 1 (4.21) 

These equations describe the intersection points of branes £>(i4)(23) and $(i2)(34)- Using 
( [4.16|) and ( |4.19|) , it is easy to see that there is only one such point (of multiplicity 2): 



( Xl ,x 2 ,x 3 ) = (2, a 2 -2, 2) (4.22) 

This is precisely one of the singular points ( |4.12|) where the moduli space M.n has A\ sin- 
gularity (for generic values of a) due to reducible representations. Therefore, we conclude 
that the cohomology of the unknot, W^^ ot , is given by the space of open string states 
for two different branes intersecting at the Ai singularity in M.h- We point out that the 
values of x% in ( |4.22[ ) can be read off directly from fig. 7. Indeed, X\ = 2 simply follows 
from the fact that the combined monodromy around the points 2 and 3 is equal to the 
identity (similarly for xs = 2). In order to explain x 2 = a 2 — 2, it is convenient to introduce 
the eigenvalues m^ 1 of the monodromy matrix V\. Of course, m is related to the local 
monodromy parameter a, namely a = m + m _1 . Moreover, since V% = V3, we have 

x 2 = tT(ViV 3 ) = m 2 + m~ 2 = a 2 - 2 (4.23) 

One can also construct the unknot using identical branes B and the braid group action 
on one of them: 



Fig. 8: Unknot as a union of two branes B with a half-twist. Each vertical line 
represents a surface (topologically a 2-sphere) which divides S 3 into two balls and 
meets the surface operator at four points. 
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Here, the two parts of the unknot correspond to the branes B and <fi ai (B), where B is the 
brane described in Q4.14Q - (|4.18| ), and o\ denotes the generator of the braid group Br%. 
Using the explicit form ( |4.13| ) of a\, we find that the brane (f) ai (B) is supported on the 
line: 

<M#) = x 2 = 2 (4.24) 

Together with eq. (|4 . 1 6| ) , this condition implies that the branes B and (f) ai (B) meet only 
at one point (of multiplicity 2): 

(x 1 ,x 2 ,x 3 ) = (2,2, a 2 -2) (4.25) 

which is precisely one of the A\ singularities ( f4.12| ) in the moduli space M.h- This is 
in complete agreement with our previous analysis, where the same configuration of D- 
branes in Ai was found starting from the presentation of the unknot shown on fig. 7. This 
agreement was expected, of course, since both presentations of the unknot on fig. 7 and 
fig. 8 are homotopy equivalent in S 3 . The second presentation (on fig. 8) can be easily 
generalized to the trefoil knot and more general torus knots (links) of type (2, k). 



Trefoil Knot : The trefoil can be constructed by joining together the brane ( |4.14| ) and the 
brane obtained by action of three half-twists on B. 




Fig. 9: The trefoil knot in S 3 can be represented as a union of two branes B with 
three half- twists. 



Starting with the equation ( [4 . 1 6|) descrining the brane B and applying a\ three times, 
we find that the brane <f>( ai ) s (#) is supported on the set of points 



xi, x 2 , x 3 ) = (4z - 2a 2 z + 2a 2 z 2 - 2z 6 + y(l - z 2 ), -2 + 2a 2 - 2a 2 z + yz + 2z 2 , z) (4.26) 



where we assumed ( |4.20| ) . Together with the equation f(xj) = 0, this condition describes 
a subvariety in M.h of complex dimension 1. Using (|4.16| ) and (|4.26|) , it is easy to see 
that the branes B and 0( CT1 )3(B) intersect at two points. The first intersection point (of 
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multiplicity 2) is precisely the singular point ( 4.25Q , as in the case of the unknot. The 
second intersection point (of multiplicity 4) is located at the regular point in M.H-, 



(x u x 2 ,x 3 ) = (2, a 2 -1,1) (4.27) 

Combining the contributions from the two intersection points, we find that the cohomology 
for the trefoil knot has the following structure 

<Si = Kn ( k 2 L©K' (2) (4-28) 
where W*^£ ot is the contribution from the first intersection point, and 7i s ^ 2 ^ denotes 



the contribution from the new intersection point (4.27). Discarding the contribution of 



reducible connections, we find the reduced cohomology of the trefoil knot, which consists 
only of the term 7i s ^ 2 \ 

nf 2) =<D 4 (4.29) 

Indeed, since M.h is smooth near the intersection point, the configuration of branes B 
and (^(o-^s (£>) can be locally described (in complex structure J) as an intersection of two 
sets of B-branes in C 2 , such that each set is supported on a line in C 2 . Let us consider a 
slightly more general problem where two sets of B-branes in C 2 contain n\ and ni branes, 
respectively. We denote by E\ and £2 the corresponding sheaves, where £\ (and similarly 
£2) is defined by a module of the form C[x\, X2]/(x ni ). The space of open string states 
between two such B-branes is given by 

Ext£ 2 (£i,£ 2 ) =<D nina (4.30) 

which, of course, is the expected result since in the present case open strings form a 
hypermultiplet transforming in (ni,ri2) under U(ni) x U{ri2)- Setting ni = ri2 = 2 gives 
(P|). 

(2, k) Torus Knots : A more general torus knot (link) T2^k can be represented as a union 
of two branes B with k half- twists. 
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k crossings 

Fig. 10: The (2, k) torus knot (link) in S 3 can be represented as a union of two 
branes B with k half- twists. 



In order to describe the action of (ci) on the brane (|4.14| ), again we use ( [4.13| ). If the 



original brane B is represented by a set of two coincident branes on the line (cf. ( [4.18| )), 

(x u x 2: x 3 ) = (2,y, a 2 - y) (4.31) 

the result of (<Ji) k action is a set of branes supported on a higher-degree curve 

<p (ai)k (B) : {x 1 ,x 2 ,x 3 ) = {P k {y),P k - 1 {y),a 2 -y) (4.32) 

where {Pi(y)}i>-i is a sequence of polynomials in y, such that Po(y) = 2, P_i(y) = y, 
and P{(y), i > 1 are determined by the recursion relation 

Pi(y) = 2a 2 - (a 2 - y)P t -i(y) - P % - 2 {y) 
For example, the first few polynomials P%{y) look like 

Px{y) = y 

P 2 (y) = -2 + 2a 2 -a 2 y + y 2 

P 3 ( y ) = 4a 2 - 2a 4 - 3y + 2a 2 y + a 4 y - 2a 2 y 2 + y 3 

p 4 ( y ) = 2 - 4a 4 + 2a 6 + 8a 2 y - Aa A y - a 6 y - Ay 2 + 2a V + 3a V - 3a V + y 4 



For simplicity, let us focus on torus knots, which correspond to odd values of k (the case 
of k even, which corresponds to torus links, can be treated similarly). Then, it is easy to 
see that the brane (j)( ai \k{B) meets the brane ( |4.16| ) at (k + l)/2 points in M.R. As in the 
case of the trefoil knot, one intersection point (of multiplicity 2) is the point ( |4. 25| ) where 
M.h has Ax singularity due to reducible connections. The other (k — l)/2 points (each of 
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multiplicity 4) are generically located at regular points in M-n'-, their precise location is 
determined by the explicit form of Pi(y). Therefore, extending the earlier result ( |4.28|) , we 



find that cohomology TC^ of the torus knot T 2 ^ is isomorphic to a direct sum of Ti.^^ not 
and (k — l)/2 copies of H. s ^ 2 ^ = (D 4 . As usual, it is convenient to remove the contribution of 
reducible solutions. If we denote by 7Y^ 2 ' ) the "reduced" cohomology of K for the theory 
considered here, we can state our conclusion as 

dim?^ = 2(fc-l) (4.33) 

In general, the cohomology H, S J^ 2 ^ categorifies a variant of the Casson invariant obtained 
by counting flat SL(2,G) connections on the knot complement S 3 \K with fixed conjugacy 
class of the holonomy around the meridian, 

X {nf 2) ) = 2a{K) (4.34) 

We expect that, at least for a certain class of knots, cr(K) is the ordinary knot signature. 
Notice, that for (2, k) torus knots, we have cr(T2,k) = (k — 1). 

Finally, we note that one could obtain a different knot invariant (and, presumably, a 
different knot homology) by considering the image of the representation variety of the knot 
complement in the representation variety of the boundary torus, see e.g. Indeed, the 
boundary of the knot complement Y \ K can be identified with T 2 in the usual way, and 
the inclusion T 2 e — » Y \ K induces the restriction map 

r: M% t (Y\K)^M% t (T 2 ) (4.35) 

which maps a representation p : tv\(Y\ K) — ► G c to its restriction p\ T 2 : %i(T 2 ) — > G c . In 
general, Ai^^ t (Y \ K) is a branched cover of its image in A^^ t (T 2 ) under the restriction 
map ( |4.35| ) . For example, if G c = SL(2,G) and Y = S 3 then, ignoring the multiplicity, 
the image of the representation variety M.^^ t (S 3 \ K) under the restriction map can be 
described as the zero locusi of the A-polynomial fflU, 



A(l,m)=0 (4.36) 



7 A-polynomial plays an important role in quantization of Chern-Simons theory with complex 



gauge group G c = SX(2, (D), see [70|. 
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where the complex variables / and m parameterize, respectively, the conjugacy classes of 
the holonomy of the flat £X(2,C) connection along the longitude and the meridian of the 
knot. The A-polynomial of every knot has a factor (/ — 1) due to reducible representations. 
For example, the A-polynomial of a (2, k) torus knot looks like 

A(T 2 , k ) = (l-l)(lm 2k + l) (4.37) 

Notice, in this example, the part containing irreducible representations consists of a single 
curve, lm 2k + l = 0, of degree one in I. On the other hand, the £X(2,C) representation vari- 
ety of T2,k is a cover of this curve by distinct irreducible components which correspond 
to irreducible representations counted by Af = 4 topological gauge theory. Restricting the 
complex variables / and m to be on a unit circle, we obtain the image of the SU(2) repre- 
sentation variety. For (2, k) torus knots, the 577(2) representation variety (again, ignoring 
reducible representations) is a disjoint union of nested open acrs [[f2||73|| . 
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